Implementation of peer support for people with severe mental health conditions in high-, middle- and low-income-countries: a theory of change approach.

BACKGROUND: Stakeholder engagement is essential to the design, implementation and evaluation of complex mental health interventions like peer support. Theory of Change (ToC) is commonly used in global health research to help structure and promote stakeholder engagement throughout the project cycle. Stakeholder insights are especially important in the context of a multi-site trial, in which an intervention may need to be adapted for implementation across very different settings while maintaining fidelity to a core model. This paper describes the development of a ToC for a peer support intervention to be delivered to people with severe mental health conditions in five countries as part of the UPSIDES trial. METHODS: One hundred thirty-four stakeholders from diverse backgrounds participated in a total of 17 workshops carried out at six UPSIDES implementing sites across high-, middle- and low-income settings (one site each in India, Israel, Uganda and Tanzania; two sites in Germany). The initial ToC maps created by stakeholders at each site were integrated into a cross-site ToC map, which was then revised to incorporate additional insights from the academic literature and updated iteratively through multiple rounds of feedback provided by the implementers. RESULTS: The final ToC map divides the implementation of the UPSIDES peer support intervention into three main stages: preparation, implementation, and sustainability. The map also identifies three levels of actors involved in peer support: individuals (service users and peer support workers), organisations (and their staff members), and the public. In the UPSIDES trial, the ToC map proved especially helpful in characterising and distinguishing between (a) common features of peer support, (b) shared approaches to implementation and (c) informing adaptations to peer support or implementation to account for contextual differences. CONCLUSIONS: UPSIDES is the first project to develop a multi-national ToC for a mental health peer support intervention. Stakeholder engagement in the ToC process helped to improve the cultural and contextual appropriateness of a complex intervention and ensure equivalence across sites for the purposes of a multi-site trial. It may serve as a blueprint for implementing similar interventions with a focus on recovery and social inclusion among people with mental ill-health across diverse settings. TRIAL REGISTRATION: ISRCTN26008944 (Registration Date: 30/10/2019).

Development of the UPSIDES global mental health training programme for peer support workers: Perspectives from stakeholders in low, middle and high-income countries.

BACKGROUND: Peer support in mental health is a low-threshold intervention with increasing evidence for enhancing personal recovery and empowerment of persons living with severe mental health conditions. As peer support spreads globally, there is a growing need for peer support training programmes that work well in different contexts and cultures. This study evaluates the applicability and transferability of implementing a manualised multi-national training programme for mental health peer support workers called UPSIDES from the perspective of different local stakeholders in high-, middle-, and low-income countries. METHOD: Data from seven focus groups across six study sites in Africa (Tanzania, Uganda), Asia (India, Israel), and Europe (Germany 2 sites) with 44 participants (3 service users, 7 peer support workers, 25 mental health staff members, 6 clinical directors and 3 local community stakeholders) were thematically analysed. RESULTS: 397 codes were identified, which were thematically analysed. Five implementation enablers were identified: (i) Enhancing applicability through better guidance and clarity of training programme management, (ii) provision of sufficient time for training, (iii) addressing negative attitudes towards peer support workers by additional training of organisations and staff, (iv) inclusion of core components in the training manual such as communication skills, and (v) addressing cultural differences of society, mental health services and discrimination of mental health conditions. DISCUSSION: Participants in all focus groups discussed the implementation of the training and peer support intervention to a greater extent than the content of the training. This is in line with growing literature of difficulties in the implementation of peer support including difficulties in hiring peer support workers, lack of funding, and lack of role clarity. The results of this qualitative study with stakeholders from different mental health settings worldwide emphasises the need to further investigate the successful implementation of peer support training. All results have been incorporated into the manualisation of the UPSIDES peer support training.

Investment case for small and sick newborn care in Tanzania: systematic analyses.

BACKGROUND: Small and sick newborn care (SSNC) is critical for national neonatal mortality reduction targets by 2030. Investment cases could inform implementation planning and enable coordinated resource mobilisation. We outline development of an investment case for Tanzania to estimate additional financing for scaling up SSNC to 80% of districts as part of health sector strategies to meet the country's targets. METHODS: We followed five steps: (1) reviewed national targets, policies and guidelines; (2) modelled potential health benefits by increased coverage of SSNC using the Lives Saved Tool; (3) estimated setup and running costs using the Neonatal Device Planning and Costing Tool, applying two scenarios: (A) all new neonatal units and devices with optimal staffing, and (B) half new and half modifying, upgrading, or adding resources to existing neonatal units; (4) calculated budget impact and return on investment (ROI) and (5) identified potential financing opportunities. RESULTS: Neonatal mortality rate was forecast to fall from 20 to 13 per 1000 live births with scale-up of SSNC, superseding the government 2025 target of 15, and close to the 2030 Sustainable Development Goal 3.2 target of <12. At 85% endline coverage, estimated cumulative lives saved were 36,600 by 2025 and 80,000 by 2030. Total incremental costs were estimated at US$166 million for scenario A (US$112 million set up and US$54 million for running costs) and US$90 million for scenario B (US$65 million setup and US$25 million for running costs). Setup costs were driven by infrastructure (83%) and running costs by human resources (60%). Cost per capita was US$0.93 and the ROI is estimated to be between US$8-12 for every dollar invested. CONCLUSIONS: ROI for SSNC is higher compared to other health investments, noting many deaths averted followed by full lifespan. This is conservative since disability averted is not included. Budget impact analysis estimated a required 2.3% increase in total government health expenditure per capita from US$40.62 in 2020, which is considered affordable, and the government has already allocated additional funding. Our proposed five-step SSNC investment case has potential for other countries wanting to accelerate progress.

Protecting small and sick newborn care in the COVID-19 pandemic: multi-stakeholder qualitative data from four African countries with NEST360.

BACKGROUND: Health system shocks are increasing. The COVID-19 pandemic resulted in global disruptions to health systems, including maternal and newborn healthcare seeking and provision. Yet evidence on mitigation strategies to protect newborn service delivery is limited. We sought to understand what mitigation strategies were employed to protect small and sick newborn care (SSNC) across 65 facilities Kenya, Malawi, Nigeria and Tanzania, implementing with the NEST360 Alliance, and if any could be maintained post-pandemic. METHODS: We used qualitative methods (in-depth interviews n=132, focus group discussions n=15) with purposively sampled neonatal health systems actors in Kenya, Malawi, Nigeria and Tanzania. Data were collected from September 2021 - August 2022. Topic guides were co-developed with key stakeholders and used to gain a detailed understanding of approaches to protect SSNC during the COVID-19 pandemic. Questions explored policy development, collaboration and investments, organisation of care, human resources, and technology and device innovations. Interviews were conducted by experienced qualitative researchers and data were collected until saturation was reached. Interviews were digitally recorded and transcribed verbatim. A common coding framework was developed, and data were coded via NVivo and analysed using a thematic framework approach. FINDINGS: We identified two pathways via which SSNC was strengthened. The first pathway, COVID-19 specific responses with secondary benefit to SSNC included: rapid policy development and adaptation, new and collaborative funding partnerships, improved oxygen systems, strengthened infection prevention and control practices. The second pathway, health system mitigation strategies during the pandemic, included: enhanced information systems, human resource adaptations, service delivery innovations, e.g., telemedicine, community engagement and more emphasis on planned preventive maintenance of devices. Chronic system weaknesses were also identified that limited the sustainability and institutionalisation of actions to protect SSNC. CONCLUSION: Innovations to protect SSNC in response to the COVID-19 pandemic should be maintained to support resilience and high-quality routine SSNC delivery. In particular, allocation of resources to sustain high quality and resilient care practices and address remaining gaps for SSNC is critical.

Blood culture versus antibiotic use for neonatal inpatients in 61 hospitals implementing with the NEST360 Alliance in Kenya, Malawi, Nigeria, and Tanzania: a cross-sectional study.

BACKGROUND: Thirty million small and sick newborns worldwide require inpatient care each year. Many receive antibiotics for clinically diagnosed infections without blood cultures, the current 'gold standard' for neonatal infection detection. Low neonatal blood culture use hampers appropriate antibiotic use, fuelling antimicrobial resistance (AMR) which threatens newborn survival. This study analysed the gap between blood culture use and antibiotic prescribing in hospitals implementing with Newborn Essential Solutions and Technologies (NEST360) in Kenya, Malawi, Nigeria, and Tanzania. METHODS: Inpatient data from every newborn admission record (July 2019-August 2022) were included to describe hospital-level blood culture use and antibiotic prescription. Health Facility Assessment data informed performance categorisation of hospitals into four tiers: (Tier 1) no laboratory, (Tier 2) laboratory but no microbiology, (Tier 3) neonatal blood culture use < 50% of newborns receiving antibiotics, and (Tier 4) neonatal blood culture use > 50%. RESULTS: A total of 144,146 newborn records from 61 hospitals were analysed. Mean hospital antibiotic prescription was 70% (range = 25-100%), with 6% mean blood culture use (range = 0-56%). Of the 10,575 blood cultures performed, only 24% (95%CI 23-25) had results, with 10% (10-11) positivity. Overall, 40% (24/61) of hospitals performed no blood cultures for newborns. No hospitals were categorised as Tier 1 because all had laboratories. Of Tier 2 hospitals, 87% (20/23) were District hospitals. Most hospitals could do blood cultures (38/61), yet the majority were categorised as Tier 3 (36/61). Only two hospitals performed > 50% blood cultures for newborns on antibiotics (Tier 4). CONCLUSIONS: The two Tier 4 hospitals, with higher use of blood cultures for newborns, underline potential for higher blood culture coverage in other similar hospitals. Understanding why these hospitals are positive outliers requires more research into local barriers and enablers to performing blood cultures. Tier 3 facilities are missing opportunities for infection detection, and quality improvement strategies in neonatal units could increase coverage rapidly. Tier 2 facilities could close coverage gaps, but further laboratory strengthening is required. Closing this culture gap is doable and a priority for advancing locally-driven antibiotic stewardship programmes, preventing AMR, and reducing infection-related newborn deaths.

Devices and furniture for small and sick newborn care: systematic development of a planning and costing tool.

BACKGROUND: High-quality neonatal care requires sufficient functional medical devices, furniture, fixtures, and use by trained healthcare workers, however there is lack of publicly available tools for quantification and costing. This paper describes development and use of a planning and costing tool regarding furniture, fixtures and devices to support scale-up of WHO level-2 neonatal care, for national and global newborn survival targets. METHODS: We followed a systematic process. First, we reviewed planning and costing tools of relevance. Second, we co-designed a new tool to estimate furniture and device set-up costs for a default 40-bed level-2 neonatal unit, incorporating input from multi-disciplinary experts and newborn care guidelines. Furniture and device lists were based off WHO guidelines/norms, UNICEF and national manuals/guides. Due to lack of evidence-based quantification, ratios were based on operational manuals, multi-country facility assessment data, and expert opinion. Default unit costs were from government procurement agency costs in Kenya, Nigeria, and Tanzania. Third, we refined the tool by national use in Tanzania. RESULTS: The tool adapts activity-based costing (ABC) to estimate quantities and costs to equip a level-2 neonatal unit based on three components: (1) furniture/fixtures (18 default but editable items); (2) neonatal medical devices (16 product categories with minimum specifications for use in low-resource settings); (3) user training at device installation. The tool was used in Tanzania to generate procurement lists and cost estimates for level-2 scale-up in 171 hospitals (146 District and 25 Regional Referral). Total incremental cost of all new furniture and equipment acquisition, installation, and user training were US$93,000 per District hospital (level-2 care) and US$346,000 per Regional Referral hospital. Estimated cost per capita for whole-country district coverage was US$0.23, representing 0.57% increase in government health expenditure per capita and additional 0.35% for all Regional Referral hospitals. CONCLUSION: Given 2.3 million neonatal deaths and potential impact of level-2 newborn care, rational and efficient planning of devices linked to systems change is foundational. In future iterations, we aim to include consumables, spare parts, and maintenance cost options. More rigorous implementation research data are crucial to formulating evidence-based ratios for devices numbers per baby. Use of this tool could help overcome gaps in devices numbers, advance efficiency and quality of neonatal care.

The role of social accountability in changing service users' values, attitudes, and interactions with the health services: a pre-post study.

This study evaluated the effects of community engagement through social accountability on service users' values, attitudes and interactions. We conducted a pre-post study of the community and provider driven social accountability intervention (CaPSAI) over a 12-month period among 1,500 service users in 8 health facilites in Ghana and in Tanzania (n = 3,000).In both countries, there were significant improvements in women's participation in household decision-making and in how service users' perceive their treatment by health workers. In both settings, however, there was a decline in women's knowledge of rights, perception of service quality, awareness of accountability mechanisms and collective efficacy in the community. Though CaPSAI intervention set out to change the values, attitudes, and interactions between community members and those providing contraceptive services, there were changes in different directions that require closer examination.

Societal and organisational influences on implementation of mental health peer support work in low-income and high-income settings: a qualitative focus group study.

OBJECTIVES: Despite the established evidence base for mental health peer support work, widespread implementation remains a challenge. This study aimed to explore societal and organisational influences on the implementation of peer support work in low-income and high-income settings. DESIGN: Study sites conducted two focus groups in local languages at each site, using a topic guide based on a conceptual framework describing eight peer support worker (PSW) principles and five implementation issues. Transcripts were translated into English and an inductive thematic analysis was conducted to characterise implementation influences. SETTING: The study took place in two tertiary and three secondary mental healthcare sites as part of the Using Peer Support in Developing Empowering Mental Health Services (UPSIDES) study, comprising three high-income sites (Hamburg and Ulm, Germany; Be'er Sheva, Israel) and two low-income sites (Dar es Salaam, Tanzania; Kampala, Uganda) chosen for diversity both in region and in experience of peer support work. PARTICIPANTS: 12 focus groups were conducted (including a total of 86 participants), across sites in Ulm (n=2), Hamburg (n=2), Dar es Salaam (n=2), Be'er Sheva (n=2) and Kampala (n=4). Three individual interviews were also done in Kampala. All participants met the inclusion criteria: aged over 18 years; actual or potential PSW or mental health clinician or hospital/community manager or regional/national policy-maker; and able to give informed consent. RESULTS: Six themes relating to implementation influences were identified: community and staff attitudes, resource availability, organisational culture, role definition, training and support and peer support network. CONCLUSIONS: This is the first multicountry study to explore societal attitudes and organisational culture influences on the implementation of peer support. Addressing community-level discrimination and developing a recovery orientation in mental health systems can contribute to effective implementation of peer support work. The relationship between societal stigma about mental health and resource allocation decisions warrants future investigation. TRIAL REGISTRATION NUMBER: ISRCTN26008944.

The impact of community and provider-driven social accountability interventions on contraceptive use: findings from a cohort study of new users in Ghana and Tanzania.

BACKGROUND: Although contraceptive use has increased over 15 years, discontinuation rates remain high. Contraceptive use is becoming more important when addressing unmet need for family planning. Social accountability, defined here as collective processes for holding duty bearers to account for their actions, is a rights-based participatory process that supports service provision and person-centred care, as well as, informed decision-making among community members regarding their health. A study implemented in Ghana and Tanzania was designed to understand and evaluate how social accountability and participatory processes influences quality of care and client satisfaction and whether this results in increased contraceptive uptake and use. We report here on the relationship between social accountability and the use of modern contraceptives, i.e., contraceptive method discontinuation, contraceptive method switching, and contraceptive discontinuation. METHODS: As part of Community and Provider driven Social Accountability Intervention (CaPSAI) Project, a cohort of women aged 15 to 49 years who were new users of contraception and accessing family planning and contraceptives services at the study facilities across both intervention and control groups were followed-up over a 12-month period to measure changes contraceptive use. RESULTS: In this cohort study over a one-year duration, we did not find a statistically significant difference in Ghana and Tanzania in overall method discontinuation, switching, and contraceptive discontinuation after exposure to a social accountability intervention. In Ghana but not in Tanzania, when stratified by the type of facility (district level vs. health centre), there were significantly less method and contraceptive discontinuation in the district level facility and significantly more method and contraceptive discontinuation in the health centres in the intervention group. In Ghana, the most important reasons reported for stopping a method were fear of side-effects, health concerns and wanting to become pregnant in the control group and fear of side-effects wanting a more effective method and infrequent sex in the intervention group. In Tanzania, the most important reasons reported for stopping a method were fear of side-effects, wanting a more effective method, and method not available in the control group compared to wanting a more effective method, fear of side-effects and health concerns in the intervention group. CONCLUSIONS: We did not demonstrate a statistically significant impact of a six-month CaPSAI intervention on contraceptives use among new users in Tanzania and Ghana. However, since social accountability have important impacts beyond contraceptive use it is important consider results of the intermediate outcomes, cases of change, and process evaluation to fully understand the impact of this intervention. TRIAL REGISTRATION: The CaPSAI Project has been registered at Australian New Zealand Clinical Trials Registry (ACTRN12619000378123, 11/03/2019).

Determining the Impact of the COVID-19 Pandemic on Availability, Use, and Readiness of Family Planning and Contraceptive Services at Selected Primary Health Care Facilities in Africa and Asia: Protocol for a Mixed Methods Study.

BACKGROUND: The COVID-19 pandemic and the associated social restrictions may have disrupted the provision of essential services, including family planning (FP) and contraceptive services. This protocol is adapted from a generic study protocol titled "Health systems analysis and evaluations of the barriers to availability and readiness of sexual and reproductive health services in COVID-19 affected areas," conducted by the World Health Organization (WHO) Department of Reproductive Health and Research. OBJECTIVE: This study aims to assess the availability and use of FP and contraceptive services in primary health facilities during and after the COVID-19 pandemic; assess the risk perceptions of COVID-19 stigma, barriers to access, and quality of services from clients' and providers' perspectives in the COVID-19-affected areas; and assess the postpandemic recovery of the facilities in the provision of FP and contraceptive services. METHODS: In-depth interviews will be conducted with clients-women in the reproductive age group and their male partners who visit the selected health facilities for FP and contraceptive services-and health providers (the most knowledgeable person on FP and contraceptive service provision) at the selected health facilities. Focus group discussions will be conducted with clients at the selected health facilities and in the community. The in-depth interviews and focus group discussions will help to understand clients' and health service providers' perspectives of FP and contraceptive service availability and readiness in COVID-19-affected areas. A cross-sectional health facility assessment will be conducted in all the selected health facilities to determine the health facility infrastructure's ability and readiness to provide FP and contraceptive services and to capture the trends in FP and contraceptive services available during the COVID-19 pandemic. Scientific approval for this study is obtained from the WHO Research Project Review Panel, and the WHO Ethics Review Committee has given ethical approval in the 3 countries. RESULTS: Using a standardized research protocol will ensure that the results from this study can be compared across regions and countries. The study was funded in March 2021. It received ethics approval from the WHO Ethics Review Committee in February 2022. We completed data collection in September 2022. We plan to complete the data analysis by March 2023. We plan to publish the study results by Summer 2023. CONCLUSIONS: The findings from this study will provide a better understanding of the impact of the COVID-19 pandemic on FP and contraceptive services at the facility level, which will help policy makers and health managers develop and strengthen FP policies and services in health facilities to be more responsive to community needs. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/43329.

Research and implementation interactions in a social accountability study: utilizing guidance for conducting process evaluations of complex interventions.

BACKGROUND: In recent years, researchers and evaluators have made efforts to identify and use appropriate and innovative research designs that account for the complexity in studying social accountability. The relationship between the researchers and those implementing the activities and how this impacts the study have received little attention. In this paper, we reflect on how we managed the relationship between researchers and implementers using the United Kingdom Medical Research Council (MRC) guidance on process evaluation of a complex intervention. MAIN BODY: The MRC guidance focuses on three areas of interaction between researchers and stakeholders involved in developing and delivering the intervention: (i) working with program developers and implementers; (ii) communication of emerging findings between researchers/evaluators and implementers; and (iii) overlapping roles of the intervention and research/evaluation. We summarize how the recommendations for each of the three areas were operationalized in the Community and Provider driven Social Accountability Intervention (CaPSAI) Project and provide reflections based on experience. We co-developed various tools, including standard operating procedures, contact lists, and manuals. Activities such as training sessions, regular calls, and meetings were also conducted to enable a good working relationship between the different partners. CONCLUSIONS: Studying social accountability requires the collaboration of multiple partners that need to be planned to ensure a good working relationship while safeguarding both the research and intervention implementation. The MRC guidance is a useful tool for making interaction issues explicit and establishing procedures. Planning procedures for dealing with research and implementers' interactions could be more comprehensive and better adapted to social accountability interventions if both researchers and implementers are involved. There is a need for social accountability research to include clear statements explaining the nature and types of relationships between researchers and implementers involved in the intervention.

Mental health workers' perspectives on peer support in high-, middle- and low income settings: a focus group study.

BACKGROUND: Peer support is increasingly acknowledged as an integral part of mental health services around the world. However, most research on peer support comes from high-income countries, with little attention to similarities and differences between different settings and how these affect implementation. Mental health workers have an important role to play in integrating formal peer support into statutory services, and their attitudes toward peer support can represent either a barrier to or facilitator of successful implementation. Thus, this study investigates mental health workers' attitudes toward peer support across a range of high- (Germany, Israel), middle- (India), and low-income country (Tanzania, Uganda) settings. METHODS: Six focus groups were conducted in Ulm and Hamburg (Germany), Butabika (Uganda), Dar es Salaam (Tanzania), Be'er Sheva (Israel), and Ahmedabad, Gujarat (India) with a total of 35 participants. Transcripts were analyzed using thematic content analysis. RESULTS: Participants across the study sites demonstrated overall positive attitudes towards peer support in mental health care, although some concerns were raised on potentially harmful effects of peer support such as negative role modelling and giving inadequate advice to service users. Notably, mental health workers from low- and middle-income countries described peer support workers as bridge-builders and emphasized the mutual benefits of peer support. Mental health workers' views on peer support workers' roles and role boundaries differed between sites. In some settings, mental health workers strongly agreed on the need for role clarity, whereas in others, mental health workers expressed mixed views, with some preferring blurred role boundaries. Regarding collaboration, mental health workers described peer support workers as supporters and utilizers, equal partners or emphasized a need for trust and commitment. CONCLUSIONS: Mental health workers' attitudes toward peer support workers were positive overall, but they also varied depending on local context, resources and previous experiences with peer support. This affected their conceptions of peer support workers' roles, role clarity, and collaboration. This study demonstrated that reconciling the need for local adaptations and safeguarding the core values of peer support is necessary and possible, especially when the implementation of recovery-oriented interventions such as peer support is accelerating worldwide.

Impact of community and provider-driven social accountability interventions on contraceptive uptake in Ghana and Tanzania.

BACKGROUND: Social accountability, which is defined as a collective process for holding duty bearers and service providers to account for their actions, has shown positive outcomes in addressing the interrelated barriers to quality sexual and reproductive health services. The Community and Provider driven Social Accountability Intervention (CaPSAI) Project contributes to the evidence on the effects of social accountability processes in the context of a family planning and contraceptive programme. METHODS: A quasi-experimental study utilizing an interrupted time series design with a control group (ITS-CG) was conducted to determine the actual number of new users of contraception amongst women 15-49 years old in eight intervention and eight control facilities per country in Ghana and Tanzania. A standardized facility audit questionnaire was used to collect facility data and completed every year in both intervention and control groups in each country from 2018-2020. RESULTS: In Ghana, the two-segmented Poisson Generalized Estimating Equation (GEE) model demonstrated no statistically significant difference at post-intervention, between the intervention and control facilities, in the level of uptake of contraceptives (excess level) (p-value = 0.07) or in the rate of change (excess rate) in uptake (p-value = 0.07) after adjusting for baseline differences. Similarly, in Tanzania, there was no statistical difference between intervention and control facilities, in the level of uptake of contraceptives (excess level) (p-value = 0.20), with the rate of change in uptake (p-value = 0.05) after adjusting for the baseline differences. There was no statistical difference in the level of or rate of change in uptake in the two groups in a sensitivity analysis excluding new users recruited in outreach activities in Tanzania. CONCLUSIONS: The CAPSAI project intervention did not result in a statistically significant increase in uptake of contraceptives as measured by the number of or increase in new users. In evaluating the impact of the intervention on the intermediate outcomes such as self-efficacy among service users, trust and countervailing power among social groups/networks, and responsiveness of service providers, cases of change and process evaluation should be considered. TRIAL REGISTRATION: The CaPSAI Project has been registered at the Australian New Zealand Clinical Trials Registry (ACTRN12619000378123, 11/03/2019).

Proportionate translation of study materials and measures in a multinational global health trial: methodology development and implementation.

OBJECTIVES: Current translation guidelines do not include sufficiently flexible translation approaches for different study materials. We aimed to develop a proportionate methodology to inform translation of all types of study materials in global health trials. DESIGN: The design included three stages: (1) categorisation of study materials, (2) integration of existing translation frameworks and (3) methodology implementation (Germany, India, Israel, Tanzania and Uganda) and refinement. PARTICIPANTS: The study population comprised 27 mental health service users and 27 mental health workers who were fluent in the local language in stage 7 (pretesting), and 54 bilingual mental health service users, aged 18 years or over, and able to give consent as judged by a clinician for step 9 (psychometric evaluation). SETTING: The study took place in preparation for the Using Peer Support in Developing Empowering Mental Health Services (UPSIDES) randomised controlled trial (ISRCTN26008944). PRIMARY OUTCOME MEASURE: The primary outcome measure was the Social Inclusion Scale (SIS). RESULTS: The typology identifies four categories of study materials: local text, study-generated text, secondary measures and primary measure. The UPSIDES Proportionate Translation Methodology comprises ten steps: preparation, forward translation, reconciliation, back translation, review, harmonisation, pretesting, finalisation, psychometric evaluation and dissemination. The translated primary outcome measure for the UPSIDES Trial (SIS) demonstrated adequate content validity (49.3 vs 48.5, p=0.08), convergent validity and internal consistency (0.73), with minimal floor/ceiling effects. CONCLUSION: This methodology can be recommended for translating, cross-culturally adapting and validating all study materials, including standardised measures, in future multisite global trials. The methodology is particularly applicable to multi-national studies involving sites with differing resource levels. The robustness of the psychometric findings is limited by the sample sizes for each site. However, making this limitation explicit is preferable to the typical practice of not reporting adequate details about measure translation and validation. TRAIL REGISTRATION NUMBER: ISRCTN26008944.

The use of segmented regression for evaluation of an interrupted time series study involving complex intervention: the CaPSAI project experience.

An interrupted time series with a parallel control group (ITS-CG) design is a powerful quasi-experimental design commonly used to evaluate the effectiveness of an intervention, on accelerating uptake of useful public health products, and can be used in the presence of regularly collected data. This paper illustrates how a segmented Poisson model that utilizes general estimating equations (GEE) can be used for the ITS-CG study design to evaluate the effectiveness of a complex social accountability intervention on the level and rate of uptake of modern contraception. The intervention was gradually rolled-out over time to targeted intervention communities in Ghana and Tanzania, with control communities receiving standard of care, as per national guidelines. Two ITS GEE segmented regression models are proposed for evaluating of the uptake. The first, a two-segmented model, fits the data collected during pre-intervention and post-intervention excluding that collected during intervention roll-out. The second, a three-segmented model, fits all data including that collected during the roll-out. A much simpler difference-in-difference (DID) GEE Poisson regression model is also illustrated. Mathematical formulation of both ITS-segmented Poisson models and that of the DID Poisson model, interpretation and significance of resulting regression parameters, and accounting for different sources of variation and lags in intervention effect are respectively discussed. Strengths and limitations of these models are highlighted. Segmented ITS modelling remains valuable for studying the effect of intervention interruptions whether gradual changes, over time, in the level or trend in uptake of public health practices are attributed by the introduced intervention. Trial Registration: The Australian New Zealand Clinical Trials registry. Trial registration number: ACTRN12619000378123. Trial Registration date: 11-March-2019.

Birthweight: EN-BIRTH multi-country validation study.

BACKGROUND: Accurate birthweight is critical to inform clinical care at the individual level and tracking progress towards national/global targets at the population level. Low birthweight (LBW) < 2500 g affects over 20.5 million newborns annually. However, data are lacking and may be affected by heaping. This paper evaluates birthweight measurement within the Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study. METHODS: The EN-BIRTH study took place in five hospitals in Bangladesh, Nepal and Tanzania (2017-2018). Clinical observers collected time-stamped data (gold standard) for weighing at birth. We compared accuracy for two data sources: routine hospital registers and women's report at exit interview survey. We calculated absolute differences and individual-level validation metrics. We analysed birthweight coverage and quality gaps including timing and heaping. Qualitative data explored barriers and enablers for routine register data recording. RESULTS: Among 23,471 observed births, 98.8% were weighed. Exit interview survey-reported weighing coverage was 94.3% (90.2-97.3%), sensitivity 95.0% (91.3-97.8%). Register-reported coverage was 96.6% (93.2-98.9%), sensitivity 97.1% (94.3-99%). Routine registers were complete (> 98% for four hospitals) and legible > 99.9%. Weighing of stillbirths varied by hospital, ranging from 12.5-89.0%. Observed LBW rate was 15.6%; survey-reported rate 14.3% (8.9-20.9%), sensitivity 82.9% (75.1-89.4%), specificity 96.1% (93.5-98.5%); register-recorded rate 14.9%, sensitivity 90.8% (85.9-94.8%), specificity 98.5% (98-99.0%). In surveys, "don't know" responses for birthweight measured were 4.7%, and 2.9% for knowing the actual weight. 95.9% of observed babies were weighed within 1 h of birth, only 14.7% with a digital scale. Weight heaping indices were around two-fold lower using digital scales compared to analogue. Observed heaping was almost 5% higher for births during the night than day. Survey-report further increased observed birthweight heaping, especially for LBW babies. Enablers to register birthweight measurement in qualitative interviews included digital scale availability and adequate staffing. CONCLUSIONS: Hospital registers captured birthweight and LBW prevalence more accurately than women's survey report. Even in large hospitals, digital scales were not always available and stillborn babies not always weighed. Birthweight data are being captured in hospitals and investment is required to further improve data quality, researching of data flow in routine systems and use of data at every level.

Kangaroo mother care: EN-BIRTH multi-country validation study.

BACKGROUND: Kangaroo mother care (KMC) reduces mortality among stable neonates ≤2000 g. Lack of data tracking coverage and quality of KMC in both surveys and routine information systems impedes scale-up. This paper evaluates KMC measurement as part of the Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study. METHODS: The EN-BIRTH observational mixed-methods study was conducted in five hospitals in Bangladesh, Nepal and Tanzania from 2017 to 2018. Clinical observers collected time-stamped data as gold standard for mother-baby pairs in KMC wards/corners. To assess accuracy, we compared routine register-recorded and women's exit survey-reported coverage to observed data, using different recommended denominator options (≤2000 g and ≤ 2499 g). We analysed gaps in quality of provision and experience of KMC. In the Tanzanian hospitals, we assessed daily skin-to-skin duration/dose and feeding frequency. Qualitative data were collected from health workers and data collectors regarding barriers and enablers to routine register design, filling and use. RESULTS: Among 840 mother-baby pairs, compared to observed 100% coverage, both exit-survey reported (99.9%) and register-recorded coverage (92.9%) were highly valid measures with high sensitivity. KMC specific registers outperformed general registers. Enablers to register recording included perceptions of data usefulness, while barriers included duplication of data elements and overburdened health workers. Gaps in KMC quality were identified for position components including wearing a hat. In Temeke Tanzania, 10.6% of babies received daily KMC skin-to-skin duration/dose of ≥20 h and a further 75.3% received 12-19 h. Regular feeding ≥8 times/day was observed for 36.5% babies in Temeke Tanzania and 14.6% in Muhimbili Tanzania. Cup-feeding was the predominant assisted feeding method. Family support during admission was variable, grandmothers co-provided KMC more often in Bangladesh. No facility arrangements for other family members were reported by 45% of women at exit survey. CONCLUSIONS: Routine hospital KMC register data have potential to track coverage from hospital KMC wards/corners. Women accurately reported KMC at exit survey and evaluation for population-based surveys could be considered. Measurement of content, quality and experience of KMC need consensus on definitions. Prioritising further KMC measurement research is important so that high quality data can be used to accelerate scale-up of high impact care for the most vulnerable.

Survey of women's report for 33 maternal and newborn indicators: EN-BIRTH multi-country validation study.

BACKGROUND: Population-based household surveys, notably the Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS), remain the main source of maternal and newborn health data for many low- and middle-income countries. As part of the Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study, this paper focuses on testing validity of measurement of maternal and newborn indicators around the time of birth (intrapartum and postnatal) in survey-report. METHODS: EN-BIRTH was an observational study testing the validity of measurement for selected maternal and newborn indicators in five secondary/tertiary hospitals in Bangladesh, Nepal and Tanzania, conducted from July 2017 to July 2018. We compared women's report at exit survey with the gold standard of direct observation or verification from clinical records for women with vaginal births. Population-level validity was assessed by validity ratios (survey-reported coverage: observer-assessed coverage). Individual-level accuracy was assessed by sensitivity, specificity and percent agreement. We tested indicators already in DHS/MICS as well as indicators with potential to be included in population-based surveys, notably the first validation for small and sick newborn care indicators. RESULTS: 33 maternal and newborn indicators were evaluated. Amongst nine indicators already present in DHS/MICS, validity ratios for baby dried or wiped, birthweight measured, low birthweight, and sex of baby (female) were between 0.90-1.10. Instrumental birth, skin-to-skin contact, and early initiation of breastfeeding were highly overestimated by survey-report (2.04-4.83) while umbilical cord care indicators were massively underestimated (0.14-0.22). Amongst 24 indicators not currently in DHS/MICS, two newborn contact indicators (kangaroo mother care 1.00, admission to neonatal unit 1.01) had high survey-reported coverage amongst admitted newborns and high sensitivity. The remaining indicators did not perform well and some had very high "don't know" responses. CONCLUSIONS: Our study revealed low validity for collecting many maternal and newborn indicators through an exit survey instrument, even with short recall periods among women with vaginal births. Household surveys are already at risk of overload, and some specific clinical care indicators do not perform well and may be under-powered. Given that approximately 80% of births worldwide occur in facilities, routine registers should also be explored to track coverage of key maternal and newborn health interventions, particularly for clinical care.

Counting on birth registration: mixed-methods research in two EN-BIRTH study hospitals in Tanzania.

BACKGROUND: Birth registration marks a child's right to identity and is the first step to establishing citizenship and access to services. At the population level, birth registration data can inform effective programming and planning. In Tanzania, almost two-thirds of births are in health facilities, yet only 26% of children under 5 years have their births registered. Our mixed-methods research explores the gap between hospital birth and birth registration in Dar es Salaam, Tanzania. METHODS: The study was conducted in the two Tanzanian hospital sites of the Every Newborn-Birth Indicators Research Tracking in Hospitals (EN-BIRTH) multi-country study (July 2017-2018). We described the business processes for birth notification and registration and collected quantitative data from women's exit surveys after giving birth (n = 8038). We conducted in-depth interviews (n = 21) to identify barriers and enablers to birth registration among four groups of participants: women who recently gave birth, women waiting for a birth certificate at Temeke Hospital, hospital employees, and stakeholders involved in the national birth registration process. We synthesized findings to identify opportunities to improve birth registration. RESULTS: Standard national birth registration procedures were followed at Muhimbili Hospital; families received birth notification and were advised to obtain a birth certificate from the Registration, Insolvency, and Trusteeship Agency (RITA) after 2 months, for a fee. A pilot programme to improve birth registration coverage included Temeke Hospital; hand-written birth certificates were issued free of charge on a return hospital visit after 42 days. Among 2500 women exit-surveyed at Muhimbili Hospital, 96.3% reported receiving a birth notification form and nearly half misunderstood this to be a birth certificate. Of the 5538 women interviewed at Temeke Hospital, 33.0% reported receiving any documentation confirming the birth of their child. In-depth interview respondents perceived birth registration to be important but considered both the standard and pilot processes in Tanzania complex, burdensome and costly to both families and health workers. CONCLUSION: Birth registration coverage in Tanzania could be improved by further streamlining between health facilities, where most babies are born, and the civil registry. Families and health workers need support to navigate processes to register every child.

Birthweight measurement processes and perceived value: qualitative research in one EN-BIRTH study hospital in Tanzania.

BACKGROUND: Globally an estimated 20.5 million liveborn babies are low birthweight (LBW) each year, weighing less than 2500 g. LBW babies have increased risk of mortality even beyond the neonatal period, with an ongoing risk of stunting and non-communicable diseases. LBW is a priority global health indicator. Now almost 80% of births are in facilities, yet birthweight data are lacking in most high-mortality burden countries and are of poor quality, notably with heaping especially on values ending in 00. We aimed to undertake qualitative research in a regional hospital in Dar es Salaam, Tanzania, observing birthweight weighing scales, exploring barriers and enablers to weighing at birth as well as perceived value of birthweight data to health workers, women and stakeholders. METHODS: Observations were undertaken on type of birthweight scale availability in hospital wards. In-depth semi-structured interviews (n = 21) were conducted with three groups: women in postnatal and kangaroo mother care wards, health workers involved in birthweight measurement and recording, and stakeholders involved in data aggregation in Temeke Hospital, Tanzania, a site in the EN-BIRTH study. An inductive thematic analysis was undertaken of translated interview transcripts. RESULTS: Of five wards that were expected to have scales, three had functional scales, and only one of the functional scales was digital. The labour ward weighed the most newborns using an analogue scale that was not consistently zeroed. Hospital birthweight data were aggregated monthly for reporting into the health management information system. Birthweight measurement was highly valued by all respondents, notably families and healthcare workers, and local use of data was considered an enabler. Perceived barriers to high quality birthweight data included: gaps in availability of precise weighing devices, adequate health workers and imprecise measurement practices. CONCLUSION: Birthweight measurement is valued by families and health workers. There are opportunities to close the gap between the percentage of babies born in facilities and the percentage accurately weighed at birth by providing accurate scales, improving skills training and increasing local use of data. More accurate birthweight data are vitally important for all babies and specifically to track progress in preventing and improving immediate and long-term care for low birthweight children.